Custom OpenAI Style Provider
- Listed as
custom
in the provider list. - ESA
This provider enables you to use OpenAI proxies as well as custom endpoints that utilize the same syntax as OpenAI's API.
Quick Start Guide
Update your agent settings
- Set
AI_PROVIDER
tocustom
. - Set
API_URI
to the URI of your endpoint. For example,https://api.openai.com/v1/engines/davinci/completions
. - Set
API_KEY
to the API key for your endpoint if applicable, leave empty if not. - Set
AI_MODEL
togpt-3.5-turbo-16k
if that is the model you would prefer to use. - Set
AI_TEMPERATURE
to a value between 0 and 1. The higher the value, the more creative the output. - Set
AP_TOP_P
to a value between 0 and 1, generally keeping this closer to 1 is better. - Set
MAX_TOKENS
to the maximum number of tokens to generate. The higher the value, the longer the output. The maximum forgpt-3.5-turbo
is 4000,gpt-4
is 8000,gpt-3.5-turbo-16k
is 16000.